Update some python packages to align with Spack #8116

iarspider · 2022-10-03T13:04:20Z

iarspider · 2022-10-03T13:04:27Z

please test

cmsbuild · 2022-10-03T13:04:39Z

A new Pull Request was created by @iarspider for branch IB/CMSSW_12_6_X/master.

@smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2022-10-03T21:43:35Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7edfd5/27933/summary.html
COMMIT: 31a9c9f
CMSSW: CMSSW_12_6_X_2022-10-02-2300/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8116/27933/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@fwyzard Set ALPAKA_DEFAULT_HOST_MEMORY_ALIGNMENT=128 #8107

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7edfd5/27933/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7edfd5/27933/git-merge-result

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-7edfd5/41834.0_TTbar_14TeV+2026D94+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal

Summary:

No significant changes to the logs found
Reco comparison results: 5 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3432650
DQMHistoTests: Total failures: 6
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3432622
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 204 log files, 49 edm output root files, 49 DQM output files
TriggerResults: no differences found

iarspider · 2022-10-04T07:18:46Z

please tesst

iarspider · 2022-10-04T07:18:51Z

please test

cmsbuild · 2022-10-04T07:18:52Z

Pull request #8116 was updated.

cmsbuild · 2022-10-04T12:22:09Z

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7edfd5/27974/summary.html
COMMIT: 5328e88
CMSSW: CMSSW_12_6_X_2022-10-03-2300/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8116/27974/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found errors in the following unit tests:

---> test createDBObjecs had ERRORS

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-7edfd5/41834.0_TTbar_14TeV+2026D94+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal

Summary:

No significant changes to the logs found
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 9 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3432650
DQMHistoTests: Total failures: 9
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3432619
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 204 log files, 49 edm output root files, 49 DQM output files
TriggerResults: no differences found

iarspider · 2022-10-04T12:41:29Z

please test

cmsbuild · 2022-10-04T17:59:09Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7edfd5/27983/summary.html
COMMIT: 5328e88
CMSSW: CMSSW_12_6_X_2022-10-03-2300/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8116/27983/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7edfd5/27983/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7edfd5/27983/git-merge-result

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-7edfd5/41834.0_TTbar_14TeV+2026D94+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal

Summary:

No significant changes to the logs found
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 9 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3432650
DQMHistoTests: Total failures: 9
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3432619
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 204 log files, 49 edm output root files, 49 DQM output files
TriggerResults: no differences found

iarspider · 2022-10-12T11:33:36Z

+externals

@smuzaffar ok to merge?

cmsbuild · 2022-10-12T11:33:58Z

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_12_6_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

iarspider · 2022-10-12T11:37:29Z

please test

cmsbuild · 2022-10-12T11:37:43Z

Pull request #8116 was updated.

smuzaffar · 2022-10-12T13:56:18Z

+externals

@smuzaffar ok to merge?

not yet, lets wait for cms-sw/cmssw#39697

cmsbuild · 2022-10-12T18:40:46Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7edfd5/28192/summary.html
COMMIT: ca400f1
CMSSW: CMSSW_12_6_X_2022-10-11-2300/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8116/28192/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-7edfd5/20834.0_TTbar_14TeV+2026D88+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-7edfd5/20834.75_TTbar_14TeV+2026D88_HLT75e33+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HLT75e33+HARVESTGlobal
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-7edfd5/20896.0_CloseByPGun_CE_E_Front_120um+2026D88+CE_E_Front_120um_GenSimHLBeamSpotHGCALCloseBy+DigiTrigger+RecoGlobal+HARVESTGlobal
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-7edfd5/20900.0_CloseByPGun_CE_H_Coarse_Scint+2026D88+CE_H_Coarse_Scint_GenSimHLBeamSpotHGCALCloseBy+DigiTrigger+RecoGlobal+HARVESTGlobal
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-7edfd5/21034.999_TTbar_14TeV+2026D88PU_PMXS1S2PR+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+PREMIX_PremixHLBeamSpot14PU+DigiTriggerPU+RecoGlobalPU+HARVESTGlobalPU
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-7edfd5/23234.0_TTbar_14TeV+2026D94+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3392309
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3392287
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 204 log files, 49 edm output root files, 49 DQM output files
TriggerResults: no differences found

smuzaffar · 2022-10-12T20:16:12Z

+externals

cmsbuild · 2022-10-12T20:16:35Z

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_12_6_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

Update py3-certifi to 2022.9.14 (align with Spack)

31a9c9f

cmsbuild added externals-pending orp-pending pending-signatures tests-started labels Oct 3, 2022

iarspider changed the title ~~Update py3-certifi to 2022.9.14 (align with Spack)~~ [WIP] Update some python packages to align with Spack Oct 3, 2022

cmsbuild added tests-approved and removed tests-started labels Oct 3, 2022

Update requirements.txt

5328e88

cmsbuild added tests-pending and removed tests-approved labels Oct 4, 2022

cmsbuild added tests-started and removed tests-pending labels Oct 4, 2022

cmsbuild added tests-rejected and removed tests-started labels Oct 4, 2022

cmsbuild added tests-started and removed tests-rejected labels Oct 4, 2022

cmsbuild added tests-approved and removed tests-started labels Oct 4, 2022

Update requirements.txt

d2c970e

cmsbuild removed the tests-approved label Oct 6, 2022

cmsbuild added tests-approved and removed tests-started labels Oct 10, 2022

iarspider changed the title ~~[WIP] Update some python packages to align with Spack~~ Update some python packages to align with Spack Oct 12, 2022

cmsbuild added externals-approved fully-signed and removed externals-pending pending-signatures labels Oct 12, 2022

Update requirements.txt

ca400f1

cmsbuild added externals-pending pending-signatures tests-started and removed tests-approved externals-approved fully-signed labels Oct 12, 2022

cmsbuild added tests-approved and removed tests-started labels Oct 12, 2022

cmsbuild added externals-approved fully-signed and removed externals-pending pending-signatures labels Oct 12, 2022

smuzaffar merged commit 4d8e249 into IB/CMSSW_12_6_X/master Oct 12, 2022

smuzaffar deleted the iarspider-patch-1 branch October 12, 2022 20:17

Update some python packages to align with Spack #8116

Update some python packages to align with Spack #8116

Uh oh!

Conversation

iarspider commented Oct 3, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

iarspider commented Oct 3, 2022

Uh oh!

cmsbuild commented Oct 3, 2022

Uh oh!

cmsbuild commented Oct 3, 2022

Comparison Summary

Uh oh!

iarspider commented Oct 4, 2022

Uh oh!

iarspider commented Oct 4, 2022

Uh oh!

cmsbuild commented Oct 4, 2022

Uh oh!

cmsbuild commented Oct 4, 2022

Unit Tests

Comparison Summary

Uh oh!

iarspider commented Oct 4, 2022

Uh oh!

cmsbuild commented Oct 4, 2022

Comparison Summary

Uh oh!

iarspider commented Oct 12, 2022

Uh oh!

cmsbuild commented Oct 12, 2022

Uh oh!

iarspider commented Oct 12, 2022

Uh oh!

cmsbuild commented Oct 12, 2022

Uh oh!

smuzaffar commented Oct 12, 2022

Uh oh!

cmsbuild commented Oct 12, 2022

Comparison Summary

Uh oh!

smuzaffar commented Oct 12, 2022

Uh oh!

cmsbuild commented Oct 12, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

iarspider commented Oct 3, 2022 •

edited

Loading